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ABSTRACT 



A system for overlaying a motion video signal onto an 
analog signal on a display. The system includes a motion 
video processing unit for receiving and processing the 
motion video signal into a signal having an analog video 
format, a video format analyzer and synchronizer device for 
receiving the analog signal and for determining video timing 
parameters and a corresponding original pixel clock of the 
analog signal and for controlling video timing parameters of 
the motion video signal to match the video timing param- 
eters of the analog signal determined by the video format 
analyzer and synchronizer device so as to provide an output 
motion video signal which is synchronized with the analog 
signal and a display determining device for determining the 
display of the analog output signal or the synchronized 
output motion video signal on the display. The video format 
analyzer and synchronizer device includes a video format 
analyzer for determining horizontal and vertical video tim- 
ing parameters of the analog signal, including vertical and 
horizontal sync times, active video time and vertical phase 
of the analog signal, a clock signal unit for receiving 
components of the analog signal and providing a synthesized 
clock signal to track the original pixel clock of the analog 
signal, and a frame controller for receiving a group clock 
signal, the group clock signal being a derivative of the 
synthesized clock signal, and for providing internal synchro- 
nization signals for synchronizing the video parameters of 
the motion video signal and the video parameters of the 
analog signal. - * 

143 Claims, 10 Drawing Sheets 
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SYSTEM AND METHOD FOR OVERLAY OF 
A MOTION VIDEO SIGNAL ON AN ANALOG 
VIDEO SIGNAL 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

This invention relates to a method and apparatus for 
overlaying one video signal onto another video signal. More 
particularly, it relates to a system for combining a motion 
video signal from one source and an analog RGB signal 
from another source, such as a graphics signal generated 
from a computer as might be required in a personal 
computer-based video conferencing environment. 

2. General Background 

Recently, demand has increased for improved and con- 
venient video conferencing systems. In response to such 
demand, personal computer-based video conferencing sys- 
tems which offer real-time, point-to-point video 
conferencing, have recently been proposed, including such 
video conferencing systems which not only display the 
motion video images of the video conferencing participants, 
but which allow for the collaboration and sharing of data and 
computer programs between such participants. Such systems 
generally communicate via an integrated services digital 
network (ISDN), local area network, or even over the plain 
old telephone system (POTS). 

Basically, in order to effect point-to-point video 
conferencing, an incoming motion video image from the 
non-local (far-side) party, must be decoded, converted to a 
video signal, and combined with a video signal from a local 
(near- side) camera. In addition, in the case of computer- 
based video conferencing, such video images must be fur- 
ther processed so that they may be combined with computer 
graphics, such as a user interface which controls the video 
conference session. Furthermore, in the computer-based 
video conferencing scenario, the computer is not only 
responsible for controlling the video conference session, but 
is also responsible for providing data, programs, and other 
material that is shared with the far-side party. Many of the 
aforementioned computer systems accomplish this result by 
the addition of internal circuitry or logic cards which accom- 
plish the combination of the motion video and graphics 
directly. 

FIGS. 1, 2 and 3 illustrate a display of the various types 
of images generated during a typical computer-based video 
conferencing session. More specifically, FIG. 1 illustrates a 
combined, or composite, image which might be displayed on 
the monitor of the person or person operating the video 
conferencing session on the local, or near-side, station who 
is communicating with another set of people who are located 
at a remote, or far-side, station. As seen in FIG. 1, preferably 
four windows are displayed, each containing different 
images which are either generated by the computer or by the 
various components of a video conferencing system. The 
window labeled 2 is the user's control center for initiating or 
terminating a video call or other functions as required for 
video conferencing, and is generated by a video conference 
control application or similar user interface program running 
on the computer on the near-side. As with other windows 
based applications, the video conference operator merely 
clicks on the desired task in order to effect that task. The 
window labeled 3 contains information generated by an 
application such as a spreadsheet, database or similar 
application, which is also running on the computer at the 
near-side. The data or other information contained therein 
may or may not be shared with the video conference 
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participants on the far-side. Windows 4 and 5 are actually 
each composed of two components. More particularly, the 
window "frames" 6 are generated by the aforementioned 
video conference control application, while the content of 

5 these windows are created in the components of the video 
conferencing system. Near-side window 4 displays the 
image received at the local camera; e.g., the local video 
conference participants). The far-side window 5 displays 
the image received at the remote camera; e.g., the remote 

10 video conference participant(s). 

FIG. 2 shows more clearly the image(s) created by the 
local computer. As seen therein, the contents of the near- and 
far-side windows are blank. (Although they are depicted in 
FIG. 2 as black, it will be appreciated that the contents may 

is be arbitrary). On the other hand, FIG. 3 shows the image(s) 
created by the components of the video conferencing sys- 
tem; i.e., the images received by the near- and far-side 
cameras. When the above images are combined or 
"multiplexed", the resulting display is as shown in FIG. 3. 

20 One computer-based video conferencing system is 
described in detail in U.S. Pat. No. 5,506,954, entitled 
"PC-Based Conferencing System" (Arshi et al). In the 
system shown in Arshi, real-time audio, video and data 
conferencing is effected in non- real -time "windows" envi- 

25 ronment. In order to accomplish such conferencing, analog 
video signals from a camera are first digitized by a video 
board, then decoded by a video capture module and com- 
pressed via video microcode running on a pixel processor. 
After storing the resulting compressed video in VRAM, the 

30 system's ISA bus interface transmits the compressed video 
to a host interface running on the host processor, which in 
turn, passes the compressed video on to a video manager. 
After time-stamping the compressed video for synchroniza- 
tion with the audio signals, the compressed video is trans- 

35 mitted to a communications manager, which in turn passes 
the compressed video through a digital signal processing 
(DSP) interface to an Industrial Standard Architecture (ISA) 
bus interface of an audio/communications board which 
stores the compressed video in a memory. Once the com- 

40 pressed video is thus stored, it is formatted for ISDN 
transmission to a remote site. 

Prior art systems such as discussed above have several 
disadvantages. For example, in order to effect computer- 
based video conferencing, such systems generally require 

45 modification to and/or addition of existing computer hard- 
ware and/or software, which in turn requires that a user open 
and remove the computer case. This is inconvenient and 
costly to the user, and subjects the computer to a number of 
extraneous problems. Although an alternative to opening the 

50 computer case would be to use an "add in" product, such as 
a standard PCI bus plug-in card, most current "add in" 
products require the use of a significant portion of the 
computer's resources and computation capability. This can 
impair the ability of the computer to share applications with 

55 another party to the video conference session; i.e., collabo- 
rative data conferencing. Therefore "add in" products are not 
a viable alternative. Another problem which occurs with 
modification of existing computer hardware and/or software 
is that such modifications might negatively impact the 

60 possibility for future modifications and enhancements to the 
computer. For example, changes to the system's IRQ or I/O 
are often required when implementing a video conferencing 
system, and such changes may impede or even preclude 
future changes and/or upgrades to the system which may be 

65 necessary to keep the computer viable in a given techno- 
logical environment. Finally, it is desirable to provide a 
video conferencing system which can be used almost uni- 
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versally with most computers. For example, laptops which present invention preferably includes a clock signal device, 
require high quality conferencing, network computers (NC), a programmable frame controller, and a video format ana- 
older, less powerful computers, and computers and terminals lyzer. The clock signal device provides a synthesized pixel 
which come in a closed (i.e., sealed) case, are precluded clock which is used to regenerate the original pixel clock of 
from being used for video conferencing purposes when the 5 me analog video signal, and thus for synchronizing the 
video conferencing must be added directly to the computer. motion video signal and the analog video signal. As the 
Effecting the video conferencing process outside of the case frequency of the synthesized pixel clock frequently exceeds 
of the computing device allows the range of computing th e frequency capability of many common logic devices, the 
devices to be considerably broadened so as to include these synthesized pixel clock is divided to a lower frequency 
aforementioned devices among others. 10 signal, referred to as the "Group Clock" (GCLK) signal. 

It would be desirable therefore, to provide a system for ^ GOX signal is used by the programmable frame 

overlaying motion video signals on computer graphics such controller as its dock signal, and it is the frame controller 

as would be used in a real-time computer video conferencing clock signal which is used for referencing aU timing param- 

system, wherein such system would be operable within most eters (video enve ope) of the resulting signal which is output 

computers, including laptops, network computers, and 15 to the display. Using programmable ^ integers H , and 

sealed computers, but would not require modification of ^ the programmable frame controller creates "internal' 

existing computer hardware and software, and thus would *W ^ Y*>- signals to be used in synchronization of the 

not necessitate increased cost and added inconvenience to motloa video signal with the "external and 

the user components of the analog video signal. 

20 According to yet another aspect of the invention, a 

SUMMARY OF THE INVENTION primary purpose of the video format analyzer is to analyze 

the analog video signal, in order to determine the timing 

Accordingly, it is one object of the present invention to parameters (video envelope) of such signal. Preferably, the 

provide a system and method for overlaying a motion video video format analyzer includes a counter, for measuring the 

signal onto an analog signal. 2 5 various horizontal and vertical parameters of the analog 

It is another object of the present invention to provide a video signal. The video format analyzer begins by measur- 

system and method for combining a video signal from a ing the various vertical timing parameters, including, the 

video source with an analog RGB signal, such as that start and end of active video (vertical), and the interval 

generated by a computer. between certain events to determine vertical front porch, 

It is yet another object of the present invention to provide 30 vertical back porch, and vertical active video. All of these 

a system and method for overlaying a motion video signal vertical measurements are made in units of horizontal sync 

onto computer-generated graphics. pulses (or horizontal scan lines). In this way the vertical 

It is still another object of the invention to provide a resolution of * e ™^ of * c computer video signal 12 is 

computer-based video conferencing system which works accurately determined. Similarly, the video format analyzer 

universally with any computer, including laptops, is easy to 35 * en measures the vanous horizontal tuning parameters of 

install, and which does not require modification of the me analog video signal, mcludmg the start and end of active 

computer's preexisting computer hardware and/or software. vldeo ( honzontal )> and the interval between events to deter- 

. . , , . . . , * mine horizontal front porch, horizontal back porch, and 

Another object of the invention is to provide a personal horizontal active video> m order t0 determine horizontal 

computer-based video conferencing system wherein the 4Q resolution. Unlike the vertical timing parameters, all of the 

graphics generated from the computer are directly combined norizontal measurements are made using the GCLK signal 

with motion video signals from the separate video confer- ^ ^ ^ of mcasuicmenL ^ GCLK signal is a function 

encing apparatus. 0 j me jj^^ component of the analog video signal and 

Still another object of the invention is to provide a the programmable integer H^,. While H sync is measured by 

personal computer-based video conferencing system 45 me video format analyzer, accurate valuation of H^, is 

wherein the graphics generated from the computer are desired and thus such value is determined by reference to a 

directly combined with motion video signals from the near- preselected horizontal resolution value preferably stored in 

side and far-side cameras. a i 00 k-up table in memory and derived therefrom. If the 

Therefore, in accordance with one aspect of the invention, derived value for H total is not consistent with the expected 

a system for overlaying a motion video signal onto an analog 50 horizontal resolution, H to[al is adjusted (and thus the fre- 

video signal on a display is provided, wherein the system quency of the synthesized pixel clock) until the measured 

includes a motion video processing unit for receiving and horizontal resolution of the analog video signal is equal to its 

processing the motion video signal from a motion video expected horizontal resolution. This ensures a correctly 

source into a signal having an analog format and a video synthesized pixel clock. 

format analyzer and synchronizer device for receiving the 55 According to still another aspect of a preferred embodi- 

analog video signal and for deterrnining video timing param- men t 0 f the present invention, in order for the video formal 

eters of the analog signal and for control ling video timing analyzer to locate and measure the timing parameters of the 

parameters of the motion video signal to match the video analog video signal, the video format analyzer must be 

timing parameters of the analog video signal determined by presented with video having known video content The 

the video format analyzer and synchronizer device so as to 60 system of the present invention is preferably communica- 

provide an output motion video signal which is synchro- UV ely coupled to a computer which includes a mechanism 

nized with the analog video signal. The system of the present fo r generating video having known video content. The 

invention further determines the display of the analog video known video generating mechanism preferably includes 

output signal or the synchronized output motion video signal software in the computer for causing a video driver to 

on the display. 65 generate a preselected number of preferably blue pixels 

According to another aspect of the present invention, the (although red or green, or combination thereof, could be 

video format analyzer and synchronizer device of the used), which are used by the system to detect the beginning 
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and end of the active video time of the analog signal, and FIG. 3 is the portion of the screen of FIG. 1 which is 

thus for determining the position and duration of the active created by a video conferencing system, 

video time of the analog signal so that this may be used to FIG. 4 is a diagram showing the preferred connection of 

control the active video time of the motion video signal. the video multiplexing system of the present invention in a 

In another aspect of the present invention, the unit for 5 com PUter video conferencing environment, 

determining the display of the analog signal or the synchro- 5 k a diagram showing the major data flow into and 

nized motion video signal on the display combines the °. ut of the vidco multiplexing system of the present inven- 

signals and determines for a preselected number of pixels of ^on . 

each of the analog signal or the synchronized motion video FIG - 6 * a block dia g ram of one embodiment of the 

signal, which of the two signals will be displayed. The ™ system architecture of the video multiplexing system of the 

display determining unit includes a video switch and a P reseDt invention. 

source controller. The video switch combines the signals and FIG * 7 1S a dia g ram showing the processing of the motion 

sources, or switches, the preselected number of pixels of the Vld f° f and me ownputer video signal in the video 

analog signal or the synchronized motion video signal to the * ul Mexing system of the present invention, 

display. This is effected under the control of the source « FIG. 8 shows a more detailed block diagram of the video 

controller, which is preferably a multiplexer control mask, format ^ and synchronizer of the video multiplexing 

having a memory for storing a plurality of values, wherein svstcm of ^ P rcscnt invention. 

each value output from the memory of the multiplexer FIG. 9 is a block diagram of one embodiment of the video 

control mask controls the sourcing of the preselected num- format a nalyzer of the present invention, 

ber of pixels by the video multiplexer to the display. In a 20 FIG. 10 is a flowchart showing the video synchronization 

preferred embodiment, the system of the present invention is process which occurs in the video multiplexing system of 

communicatively coupled to a computer having a user the present invention 

controllable video conference control application or other DETAILED DESCRIPTION OF THE 

such user interface program, such application causing the PREFERRED EMBODIMENT 

display of "windows" in which the motion video signal will 25 

be displayed. The application would allow the user of the ^ embodiment of the system and method I foi -overlaying 

system to resize or move a window in a manner similar to or multiplexing a motion video s lg nal and a RGB or similar 

the control of other "windows", and would send back to the analo S ^ now ** described in detail with reference 

multiplexer control mask for storing in its memory, infor- 10 mc accompanying drawings. 

mation reflecting these changes 30 ^ 561 forth above, in order to effect video conferencing 

In addition, according to another aspect of the present ° Wr a computer-based system, there is a need to combine 

invention, the video format analyzer can be used to deter- moton /"^ sl § nal cantoning the video conferencing 

mine whether the video is interlaced or non-interlaced. In ™ ages and oth , cr ™ { ° mat ™ ™ th generated by 

non-interlaced video, the time difference between the lead- me """P 1 ""- h 15 d f ^ to do this using the existing 

. ex, j. i. i j- j £n c.u i 35 computer software and hardware; that is, without requiring 

ing edge of V„ H< . and the leading edge of H_,„, of the analog t \ 1 .,. , . .. : ... ? 

video signal will be constant for consecutive measurement * e h addltl °° al 0051 and , ^convenience to the user of modi- 

of these events. If the video is interlaced, this difference ^ u personal computer. Additionally, it is desired 

varies by half a scan line with each V . If interlaced video * at . Such ^ f em * f le t0 °P erate ™* """ff 

a ir \ a «u a *- a a a i_ having graphics which meet or exceed VGA standards, 

is detected, the condition is nagged and operation may be ^ . , . . , ' 

aborted if desired 40 including laptops and notebooks, thus eliminating the pos- 

' . " , ,. sibility of using a standard plug-in card solution. 

_ In accordance with yet another aspect of the present , n accordance ^ 

such objective, it was determined to 

invention, the system further includes logic for generating combine ^ tef videQ ' motion ^ 

an interrupt if the vertical sync pulse of the motion video rt „ • / a u ■ \ *u *- 

, ■ 7 . • « *»l »i_ i i overlaying — or multiplexing (as used herein) — the motion 

signal is not synchronized with the vertical sync pulse of the 4J videQ 0Qt0 J comp S ut 7 generaled £ „ ^ ^ 

analog signal, ine vaeo rormat analyzer may be pro- unde[slood 

to those skilled in the art, that although the 

grammed o prevent the display determining unit from of over , ^ , mmioD video ^ onto 

displaying the motion video signal on the display until the ' „ , • , , n , nr , D -j • i 

, i r • . , ■ ; . a n analog signal (e.g., an analog RGB or video signal 

vertical syne pulse of the motion video signal becomes . j u . \ • r • 

, / . F ... . . . , s " . , generated by a computer) is preferably used in a computer- 
synchronized with the vertical sync pulse of the analog cn ? . . , * ™ • ♦ • * .• j 
• * a i* t -i.t_ -j r i . so based video conferencmg environment, it is not limited 

signal. Alternatively, the video format analyzer can be f u»~*~ a • *u > a 

j . ii .t_ j- i j - ■ thereto, and may, in fact, be used in other environments and 

programmed to allow the display determining unit to con- ^ „ • . e \ u V • i a- . i- -* a 

f. . , # . ■ , , , . . for a myriad of other applications; including, but not limited 

tinue to display the motion video signal on the display even , . a . i*- a ^ . 

. . r J . . . . & . .j . , to, broadcast, multimedia and any other computer and video 

if vertical synchronization between the motion video signal -n,.^ ,„u-i- r *u i e ■ .• •* a- 

, . J . , . , 6 appucations. Thus, while for the sake of simphcity, discus- 

and analog signal is not maintained. ,, ■ * .u *• *• n «■ J t • . 

& °^ 55 sion or the present invention is generally limited herein to 

The features of the present invention believed to be novel ^ yi deo conferencing environment, the invention is in no 

are set forth with particularity in the appended claims. wav limited thereto. 

However, the invention itself may be best understood with Definitions 

reference to the following description in conjunction with "Computer video and computer video signal" are used 

the accompanying drawings. 60 herein t0 mean an RGB video Qr sigQals 

' BRIEF DESCRIPTION OF THE DRAWINGS generated by any computer. Further, such term as used 

herein, includes both video content or information as well as 

FIG. 1 is an example of a screen having multiple "win- format and timing information that is necessary and separate 

dows" which might be displayed on the local, or near-side, from the video content. 

monitor during a video conferencing session. 65 "Far side image" is used herein to mean the motion video 

FIG. 2 is the portion of the screen of FIG. 1 which is image sent from the remote site or sites participating in the 

generated by the local, or near-side, computer. video conferencing session. 
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"Group clock** or "GCLK" is used herein to mean a of the present invention. This data and control path 15 is 

derivative of the "synthesized pixel clock". In the preferred used to send messages to and from the computer and video 

embodiment, it is the "synthesized pixel clock" divided by multiplexing system 13 of the present invention. (While the 

four, and thus one GCLK period is required to shift out four data and control path 15 is preferably the computer's parallel 

pixels from the phase locked loop or similar device. 5 port 21, it will be understood that any generally accessible, 

"Horizontal total" or "H^,^" is used herein to mean the external, bi-directional port, such as a serial port or USB port 

number of pixel groups contained in a single horizontal scan may be used instead). The video multiplexing system 13 of 

line. "H totaJ " is the sum of the horizontal pulse sync width, the present invention combines the computer video signal 12 

horizontal back porch ("H^^^^"), horizontal active time, generated from the computer with incoming video signals 

and horizontal front porch ("H^, /JorcA ") (as measured in 10 from a local camera (near side) and from a distant camera 

pixel groups). (far side), and provides the resulting output on a monitor 20, 

"Motion video signal" is used in the preferred embodi- as will be described in more detail in the following para- 

ment to mean the "video signal" originating in the video graphs. The general flow of data into and out of the video 

conferencing system outside of the computer. multiplexing system 13 may be understood with reference to 

"Multiplexing" is used herein to mean the act of comb in- 15 FIG. 5. 

ing separate sub-images each of which may have differing As seen therein, images from the computer 10 are trans- 

"video envelopes". milted to the video multiplexing system 13 in the standard 

"Near side image" or "vanity window" is used herein to output format and over the standard path as would normally 

mean the motion video image generated by a local camera be sent directly to the monitor 20. Motion video from the 

in a video conferencing environment. It is optionally dis- 20 remote (far-side) camera (not shown) is received in a video 

played on the local screen. CODEC (not shown) in the video conferencing system and 

"Pixel clock" is used herein to mean the periodic digital transferred to the video multiplexing system 13, while 

clock associated with the computer video signal or other motion video from the local (near-side) camera is sent 

"video signal" from which all components of the "video directly from the local camera to the video multiplexing 

signal" are referenced. It is preferably a high frequency 25 system 13. A composite image (as discussed above) is then 

signal, the rate of which defines when the pixels are updated. output from the video multiplexing system 13 for display on 

A derivative of the "pixel clock" or "group clock" (GCLK) the monitor 20, and the image from the near-side camera is 

is used to create the horizontal sync component of the "video sent to a video conferencing encoder (not shown) where it is 

envelope" of the computer video signal. "Original pixel appropriately encoded before transmission to the far-side 

clock" will be used to mean the pixel clock of the source of 30 system. 

the "video signal", while "synthesized pixel clock" will be Configuration and Operation of the Video Multiplexing 

used herein to mean that pixel clock generated by a phase- System 

locked loop which is iteratively adjusted so that it tracks the A preferred embodiment of the video multiplexing system 

"original pixel clock". of the present invention as used in a videoconferencing 

"Pixel group" is used herein to mean four pixels, although 35 environment will be described with reference to FIGS. 6, 7 

it will be understood that in other embodiments, a different and 8. In operation, it will appreciated that, initially, the 

number may instead be used. computer video signal 12 which is output from the host 

"Video content" or "video information" is used herein to computer 10 passes directly through the video switch 14 

mean a temporal and spatial dependent stream of data through video amplifier 16 to the monitor 20 unaffected 

representing Red, Green and Blue components of an image, 40 (FIG. 6). Thus, the video multiplexing system passes the 

the latter of which may be either static or dynamic. "Video computer video signal 12 without modification. However 

content** may be separated from the "video envelope*' in the according to the objects of the present invention, such 

"video signal'* for the purpose of compression, encoding, or computer video signal 12 from computer 10 (or graphics 

other image processing purposes. For example, "video con- from some first video source) must be directly combined, in 

tent" could be separated from its "video signal*' and inserted 45 real-time, with motion video generated from a second video 

into another "video signal" for a picture- in -picture (PIP) source or sources. In the preferred embodiment, wherein the 

effect. multiplexing system of the present invention is used in a 

"Video envelope" is used herein to mean a composition of videoconferencing environment, the motion video is pro- 
signal components with specific timing relationships used to vided from a local video camera 33 (near-side video images) 
convey a video image between two points. Signal compo- 50 and a distant or remote video camera (far-side video 
nents typically include Red, Green, Blue, horizontal sync, images). Thus it is necessary for the motion video signals 
and vertical sync. "Video content** is inserted into the "video generated from the near- and far-side cameras (in the pre- 
envelope" to result in a complete "video signal**. If no ferred embodiment) to operate within the same timing and 
"video content" is inserted into the "video envelope'*, the format as the computer video graphics generated by the 
resulting "video signal" appears as a solid black image when 55 computer 10. Accordingly, in the preferred embodiment, the 
viewed on a display device. incoming motion video signals must be converted to analog 

"Video signal" is used herein to mean a composite signal RGB signals in order to match the color space of the 

containing "video content" within a "video envelope". computer video and the monitor 20, and the timing param- 

Overview of the Operation of the Video Multiplexing Sys- eters of the computer video signal 12, including horizontal 

tern 60 and vertical sync and active video time, must be analyzed in 

As seen in FIG. 4, a computer 10 (e.g., either a desktop, order to synchronize the motion video signals with the 

laptop PC, as seen in FIG. 1, or a NC-like device) provides computer video signal 12. The multiplexing system 13 of the 

an RGB analog computer video signal 12 (including image, present system accomplishes this in a manner which will 

timing and format information) to the multiplexing system now be discussed. 

13 of the present invention. An additional data and control 65 I. Motion Video Processing 

path 15 is established, preferably by connecting the com- Again, according to the present invention, computer video 

puter*s parallel port 21 to the video multiplexing system 13 graphics from the computer 10 must be combined, in real- 
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time, with motion video generated from a second video 
source or sources. In the preferred embodiment, wherein the 
multiplexing system of the present invention is used in a 
video conferencing environment, the motion video is gen- 
erally provided from a local video camera 33 (near-side 
video images) and a distant video camera (far-side video 
images) (FIG. 1) both of which preferably operate according 
to defined NTSC/PAL or other such standards such as 
compressed video received via a telephone interface 31. 
Again, as the motion video must be directly combined with 
the computer video signal from the computer 10, the video 
information contained in the NTSC/PAL-formatted or com- 
pressed motion video signal must be converted to an analog 
RGB format. Thus, the motion video, including video 
images and other information, generated by both the local 
video source 33 and the far-side video source (not shown), 
is captured and converted by video converter 35a or 356 to 
a 4:2:2 YUV formatted data stream, such process for con- 
version being known in the art (FIGS. 6 and 7) (If the motion 
video is either NTSC or PAL formatted, it is provided to an 
NTSC/PAL decoder 35a. If compressed video is received via 
a telephone interface 31 then it is instead decoded in an 
H.320 decoder, as known in the art (FIG. 7)). The thus 
formatted data is then placed into a video RAM (VRAM) 39 
by the video co-processor 37. VRAM 39 is preferably a 2 
MB VRAM. The video co -processor 37 converts and scales 
the YUV data to digital RGB by reading out the data from 
the VRAM 39, processing the data to convert same to digital 
RGB data through a process known in the art, and writing 
the thus digitized RGB data back into the VRAM 39. The 
digital information is then converted to an analog RGB 
signal by a video digital to analog (D/A) converter 41 before 
it is forwarded to the video switch 14. As seen in FIG. 6, the 
entire foregoing process is accomplished under the control 
of a controller 32, through bus arbitration and control logic 
45. (In one embodiment the controller 32 is a digital signal 
processor (DSP) Model No. 320C80 commercially available 
from Texas Instruments, but any similar microprocessor or 
controller as known to those skilled in the art may be 
substituted. Similarly, the video D/A converter 41 is a D/A 
converter Model No. TVP3026, also commercially available 
from Texas Instruments). 

Once the motion video signal is thus converted, it is now 
ready to be directly combined in the switch 14 with the 
computer video signal 12 from the computer 10. However, 
before the motion video signals (near- and far-side) and 
computer video signal 12 may combined, it must be ensured 
that they are first synchronized. Synchronization of these 
signals will now be discussed. 

II. Synchronization of the Motion Video and Computer 
Video Signals 

Again, it is desired that the present invention be adapted 
for use with almost any computer system, as long as the 
system graphics meet or exceed the VGA standard. Thus a 
variety of display types/formats (i.e., any of the standard 
VESA video formats) must be taken into consideration in the 
multiplexing system of the present invention. In view of 
such fact, it will be appreciated that in effecting synchroni- 
zation (in format and timing) of the motion video signal and 
the computer video signal, the format of the incoming 
computer video signal is initially unknown, and thus that the 
vertical and horizontal parameters of such signal is 
unknown. As set forth above, such horizontal and vertical 
parameters must be determined in order to synchronize the 
motion video signal and the computer video signal. 

In order to synchronize the motion video signal with a 
computer video signal of an unknown format, it is important 
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that the signals' vertical sync (V JyrtC ) and horizontal sync 
(Hjync) signals, as well as active video time, occur coinci- 
dentally. It is further desired to regenerate a pixel clock for 
the motion video signal which tracks the original pixel clock 

5 of the computer video signal 12, and to use this regenerated 
pixel clock as the basis to create synchronization. The video 
format analyzer and synchronizer (VFAS) 24 is used to 
effect these tasks. 

A. Video Format Analyzer and Synchronizer 

to As seen with reference to FIGS. 6 and 8, portions of the 
computer video signal 12 (including vertical sync (V^^.), 
horizontal sync (H^y^.) and the blue component of the 
computer video signal 12) are provided to the video format 
analyzer and synchronizer (VFAS) 24, which analyzes the 

15 computer video signal 12 to extract video timing informa- 
tion. Basically, the VFAS 24 duplicates the envelope of the 
computer video signal 12 from computer 10, so that the 
signals* envelopes are synchronized. As seen in FIG. 13, the 
VFAS 24 preferably includes a programmable frame con- 

20 trailer (FC) 11, a video formal analyzer (VFA) 18 and a 
wide-band phase locked loop (PLL) 19, although the frame 
controller 11, VFA 18 and wide-band PLL 19 may each 
constitute separate devices. A more detailed description of 
the operation of the VFAS 24 and its components is dis- 

25 cussed below. 

1. Programmable Frame Controller (FC) 11 
Referring again to FIG. 8, VFAS 24 includes a program- 
mable frame controller (FC) 11. The FC 11 includes a series 
of programmable counters (not shown) and performs typical 

30 video frame controller tasks as well known in the art, such 
as the generation of and V^, and the generation of 
sequential frame buffer memory addresses for display pur- 
poses. Therefore detailed operation of FC 11 will not be 
discussed in further detail. 

35 FC 11 is used in determining the timing parameters (i.e., 
the video envelope) of the output RGB analog video signal 
22 which will be provided to the monitor 20. All timing 
parameters are thus referenced to the clock signal of the 
frame controller (FC) 11. As the frequency of the synthe- 

40 sized pixel clock frequently exceeds the frequency capabil- 
ity of many common logic devices, the synthesized pixel 
clock is divided to a lower frequency signal. This signal is 
then used as the frame controller's clock. In the preferred 
embodiment, the frame controller's clock is the synthesized 

45 pixel clock (generated by the PLL 19 — discussed below) 
divided by four (FIG. 8), which will hereinafter be referred 
to as the Group Clock (GCLK). In a preferred embodiment 
of the present invention, divider logic available in the video 
D/A converter 41 was used to divide the synthesized pixel 

50 clock. However, it will be appreciated to those skilled in the 
art that any similar logic capable of scaling frequency may 
be used (Although division is shown in the embodiment 
FIG. 8 as occurring outside of the video D/A converter, it 
will be understood that it has been illustrated as such for 

55 simplicity and ease of understanding of the present 
invention, as not meant as a limitation). 

FC 11 also generates "internal" H VBC and V^ signals, 
which are used internally within the system. Specifically, the 
"internal" V^ signal is compared with the V^ of the 

60 computer video signal 12 to determine and maintain vertical 
phasing. The "internal" V^. signal is compared with the 
V^. of the computer video signal 12 by the VFA 18 to see 
if it is coincidental therewith. If it is, then it can be concluded 
that the "internal" V^,^ is synchronized with the V^^ of the 

65 computer video signal 12 (except for possible vertical phas- 
ing adjustments, as discussed below). The "internal" H J>W . 
signal is used by the PLL 19 to synthesize or regenerate the 
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original pixel clock from the signal of the computer Thus, it should be noted from the above equation that 

video signal 12 as described in the next section below. even though the "external" frequency is unknown (and 

In order to create the "internal" signal, the FC 11 may indeed never be known), the PLL 19 can automatically 

divides this GCLK by a programmable integer value called recreate the original pixel clock of the computer video signal 

"H fatn /' to create an "internal" signal, where is 5 12 once the correct H w value is selected In other words, 

the number of group clock periods which occur in a hori- once lhe correct value for H totai is determined, it will be 

zontal scan line. This "internal" H signal is provided to possible to correctly synchronize the "external" with 

the feedback input of the phase-locked loop 18 (FIG. 8). The me "in^mal" As stated above, the determination of 

FC 11 creates the "internal" V signal by dividing the correct H [olol value is desalted later m this document. 

"internal" signal by V r< J„ the latter also being a 10 ^^J™ ^ f t , lfi 

sync o j totan » The VFAS 24 also includes a video format analyzer 18. 

programmable integer value equal to the total number of -n. wr* 10 • *li j- • -1 j 

L ~ . , i- !_• 1. • 1 c r* ■ The VFA 18 is preferably a medium-sized programmed 

horizontal scan lines which occur in a single frame. (It is ^ (pA £ contami a programmable counter, 

important to note that these internal H and although it may constimte auy simHar logic device as known 

signals used for synchronization purposes, and are separate to those m ^ ^ ^ ^ an application-specific 

and distinct from the H^„ c and V sync components, 15 integrated circuit or a field programmable gate array. One 

respectively, of the computer video signal 12. For ease and embodiment of the VFA 18 is shown in FIG. 9. 

clarity of understanding, therefore, the and a primary purpose of the video format analyzer's (VFA) 

components of the computer graphics 12, will hereinafter be 18 is that of analyzing the computer video signal 12 to 

referred to as "external H sync " and "external V^^", determine its video envelope characteristics. In most cases, 

respectively). Accurate determination of H total and V foto/ are 20 this analysis is performed by measuring the time between 

thus important in the synchronization of the motion video "events** of interest. "Events" of interest involve the video 

and computer video signals and will be discussed in more timing parameters of the computer video signal 12, and 

detail in the forthcoming paragraphs. In addition to deter- include: the leading edge of "external" H , trailing edge 

mining the above parameters, the FC 11 also determines of "external" H^^, leading edge of "external" V^ MC , trailing 

other horizontal and vertical timing parameters including 25 edge of "external" V VHel leading edge of "internal" V^ nc , 

sync width, front porch and back porch through the use of start of active video and end of active video (both horizontal 

other programmable integer values. As the relation of these and vertical). The reference time base for measurement of 

parameters to the above -discussed parameters is known to these parameters is GCLK (for measurement of events less 

those skilled in the art, they will not be discussed in detail. than or equal to a single horizontal scan line) or "external" 

2. Phase-Locked Loop (PLL) 19 30 U sjm4 . (for measurement of events longer than a single scan 

In addition to the FC 11, the video format analyzer and line). For example, V totat — the number of horizontal scan 

synchronizer (VFAS) 24 also includes a phase-locked loop lines in a frame — is determined by counting in counter 50, 

(PLL) 19. Again, it is desired to duplicate the video envelope the number of "start of external events that occur 



of the computer video signal 12 and the corresponding between two successive "start of external V^^" events, 

original pixel clock. However, while some components of 35 a. Sync Normalization by the VFA 

the video envelope of the computer video signal 12 may be In order for the VFA 18 to commence the various mea- 

simply extracted, such as and V^, the original pixel surements of the "external" pulse, it is necessary for it 

clock (of the computer video signal 12) is not contained to "know" when such pulse is being asserted. The assertion 

therein, and must be synthesized from the computer video of the external H^ wc pulse is determined by a "sync nor- 

signal 12. The purpose of the PLL 19 is to create (or 40 malization" function in normalizer 52 which makes the 

regenerate) this pixel clock and to maintain synchronization determination based upon the duty cycle of the pulse. Sync 

of — or "lock" — the FC 11 with the computer video signal normalization is necessary because the polarity of the H sync 

12. and of incoming computer video signals may vary 

In the preferred embodiment, as seen in reference to FIG. depending on the host computer 10. For example, as phase- 

8, this is accomplished through the application of the "exter- 45 locked loops such as PLL 19 operate on the edge of signals, 

nal" (again, the portion of the computer video it is required that PLL 19 be presented with an pulse 

signal 12) to the reference input of the PLL 19 and the of positive polarity. As seen with reference to FIG. 9, the 

"intemar H sync from the output of FC 11 to the feedback normalizer 52 will accept either polarity of and V 

input of the PLL 19. It will thus be appreciated that PLL 19 and respectively output a and V^ pulse of posiuve 

attempts to maintain the feedback frequency (i.e., the fre- so polarity. The normalizer 52 may be implemented in a 

quency of "internal" H^) at the same frequency as the number of ways. One implementation includes a counter 

reference frequency (i.e., the frequency of "external" H^J. which counts up when a sync signal is positive and down 

In a preferred embodiment, the PLL 19 is preferably an when a sync signal is negative; therefore, at the end of the 

ICS 1522 chip commercially available from Integrated Cir- counting period, the sign bit of the counter will correspond 

cuit Systems, Inc., 2435 Boulevard of the Generals, Valley 55 to the sign of the sync pulse. This sign bit and the original 

Forge, Pa., 19482. sync pulse are then provided as inputs to an exclusive or 

Upon achieving a "locked" state, the PLL 19 output (XOR) gate, so that the output is a positive polarity signal, 

("synthesized pixel clock" in FIG. 8) will operate at a Alternatively, the sync signal may be latched whenever 

frequency as determined according to the following equa- active video is present, and as it known that since a sync 

tion: 60 pulse is not asserted during active video, the latched value 

1.^* ^ „. ync ^ correspond to the sync polarity. It will be appreciated 

r** ..u rntv ■ 1 • „ ^ c c t_ r L that the manner by which the sync pulse is normalized is not 

Given that the GCLK signal is K the frequency ofthatofthe Umited t0 ^ embodimentS) ^ other meth ods of sync 

synthesized pixel clock, its frequency may thus be described normalization may be used instead, 

as follows: 65 b Active ^ deQ Measuremems by the vp A 

Again, one of the events of interest which the VFA 18 

W/ (J *»«w ^/cbd/Wf^L,,.,^ measures is the start and end of active video time. In order 
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to measure the active video region of the computer video (which is appropriate for most video systems which output 

signal 12, the VFA 18 measures the vertical front and back video ranging from 0.0 to 0.7 volts). The start of active video 

porches (respectively, V^, porch and V 6acJt p^^, as well as (vertical) measurement is performed by counting in counter 

the horizontal front and back porches (respectively, H^,^ 50 the number of horizontal sync pulses that occur between 

ponh and Wine* porcfd of such signal. The VFA 18 measures 5 the leading edge of "external" V 0-rtC and the horizontal scan 

V from porrzh an d ^ back pore* indirectly, by measuring the time line during which video is first detected. The end of active 

from the leading edge of "extern al" to the start of video video (vertical) measurement is performed by counting the 

C^end) and the time from the leading edge of "external" number of horizontal sync pulses which occur between the 

to the end of video (V tfMd ). However, to ensure that the VFA leading edge of "external" V^^. and the scan line during 

18 accurately measures V SIon and V end it is required that the 10 which active video is last detected. In a similar method, the 

computer video signal contain known video on both the first VFA 18 can measure the interval between events to deter- 

and last scan line. This is accomplished by having a the mine vertical front porch, vertical back porch, and vertical 

above-discussed video conference control application or active video — all measured in units of horizontal sync pulses 

similar user interface program in the computer 10 cause the (or horizontal scan lines), as known to those skilled in the 

video driver (not shown) of monitor 20 to display a border 15 art. In this way the vertical resolution of the source of the 

60 consisting of a number of pixels of a specified color at the computer video signal 12 is accurately determined, 

boundary of the screen of monitor 20 for identifying the ii. Horizontal Measurements by the VFA 

active video region of the computer video signal. (The Horizontal measurements are made in a similar manner by 

requirement for the computer to generate known video the VFA 18, the difference being that GCLK is used as the 

content comes from the fact that the VFA 18 requires 20 unit of measurement. The start of horizontal active video 

non-black video content at the borders to measure param- measurement is performed by counting in counter 50 the 

eters such as front and back porch. However, in many number of GCLK pulses which occur between the leading 

situations sufficient video content will always exist — such as edge of the "external" H^ nc pulse and the point when active 

when running Windows® 95 with the default blue desktop. video is first detected (FIG. 9). The end of horizontal active 

In other situations, a enhancement to VFA 18 could be 25 video measurement is performed by counting the number of 

created to accumulate video timing information over a GCLK pulses which occur between the leading edge of the 

period of time with the expectation that the computer would "external" H^^ pulse and the point when active video is last 

eventually display video information at the display borders.) detected. In addition to the above measurements, the VFA 18 

In the preferred embodiment, the video conference con- can measure the interval between events to determine hori- 

trol application commands the video driver to place a blue 30 zontal front porch, horizontal back porch, horizontal active 

border of eight (8) pixels around the screen of monitor 20, video — again all measured in units of GCLK, as known to 

prior to the measurement of vertical resolution by VFA 18 those skilled in the art. All of these parameters will be used 

(see above), although such border is not needed until the to determine horizontal resolution, 

VFA 18 completes the measurement of the active video However, as previously discussed, GCLK is a function of 

region discussed in this paragraph. The video conference 35 not only the "external" H frequency but of the integer 

control application then sends instructions to the VFA 18 to parameter U totaI (in the FC 11), and therefore it is important 

commence measurement of the active video time of the that H total be accurately determined and specified to the FC 

computer video signal 12 once the blue border is detected. 11 before any horizontal measurements are made. In order to 

In a preferred embodiment of the present invention, once ensure the accuracy of H fow/ , and thus determined horizontal 

measurement of the active video region has begun, the video 40 resolution, this value is not directly determined by 

conference control application sends a command over the measurement, but instead, is determined by use of a lookup 

bi-<lirectional data and control path 15 to extinguish the blue table in memory connected to controller 32. Determination 

border. In the above-discussed preferred embodiment, the of H^, will now be discussed. 

video conference control application controls the com- Measurement of H^, and Video Synchronization by the 

mencement and substantially controls the termination of this 45 Video Format Analyzer and Synchronizer (VFAS) 

operation (the multiplexing system may send interrupt com- FIG. 10 shows a flowchart of the basic steps associated 

mands to terminate the operation in certain circumstances, with establishing a video locked state between the motion 

otherwise the blue border will be extinguished automatically video signals and the computer video signal 12. (FIG. 10 

after a set time period). However, it will be appreciated that, shows a preferred embodiment of the steps in establishing a 

alternatively, the video multiplexing system 13 of the 50 video locked state. Those skilled in the art will appreciate 

present invention may instead control the commencement that the order of the steps may be altered, and or steps 

and termination of this operation. (It will also be appreciated removed as desired). Description of mis process will now be 

that the although the "depth" of the border is preferably eight described. 

pixels, such "depth" may instead constitute a different First, as set forth above, vertical resolution of the corn- 
number of pixels and that another color, such as green or red 55 puter is measured in step S10. Again, the video conference 
pixels may be used instead of blue. Alternatively, a combi- control application running in computer 10 causes the video 
nation of such colors may be used, although it is simpler to driver in computer 10 to display a preferably blue border on 
use one of these primary colors. Additionally, it will be the screen of monitor 20. Using this blue border, the VFA 18 
appreciated that instead of the automatic extinguishing of measures the vertical active video which, in turn, directly 
the blue border, if desired, the appearance of the blue border 60 determines the vertical resolution of the computer video 
on the screen of monitor 20 may be eliminated through signal 12. 

known video techniques such as chroma-keying.) After this measurement, the H totaJ must be determined, 

i. Vertical Measurement by the VFA Again, this value will be used to synthesize an "internal" 

Once the blue border is established, the high speed H^ and the synthesized pixel clock. In step S20, the 

comparator 54 signals when video is present (FIG. 9). In the 65 controller 32 uses the thus determined vertical resolution to 

embodiment of the VFA 18 shown in FIG. 9, the threshold look up the corresponding horizontal resolution in the fol- 

for detection of video by the comparator 54 is 0.25 volts lowing table (TABLE 0 which is stored in memory as 
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discussed above, in order to determine H toIaI . (Although in the internal pulse and the leading edge of the V ow 

the embodiment discussed herein, horizontal resolution is pulse of the computer video signal 12. This count represents 

determined via reference to a look-up table stored in the phase difference between the motion video signal and 

memory, those skilled in the art will realize that other computer video signal 12 in units of horizontal scan lines. 

methods of determining horizontal resolution may be used 5 This phase difference is corrected by increasing V totct by the 

instead; e.g., measurement of vertical resolution and calcu- phase difference for a single frame. V Wtt/ is then immedi- 

lation of horizontal resolution using equations well known in ately restored. The two video signals should now be com- 

the art): pletely synchronized. 

Another important feature of the VFA is that if vertical 

TABLE I 10 lock between the motion video and computer video signal is 

lost (i.e., the "internal" V^. is not synchronized with the 

"external" V^), interrupt logic 56 under the control of 

control logic 58 will generate an interrupt. (FIG. 9) The VFA 

18 can be programmed to prevent multiplexing of the 

motion video and computer video signals if synchronization 

is lost. In such a case, display of motion video on monitor 

20 of computer 10 will be blanked until vertical lock is 

re-established. Likewise, multiplexing will occur only when 

. „ , . . , _^ AV . . vertical lock is re-established. Alternatively, if desired, VFA 

A value for H , is .ben estimated (step S20) by the 2Q M can ^ p rogrammed t0 multi p lex the molion video and 

o owing orm a. computer video signals irrespective of whether vertical lock 

//^est.H-2*(Expected Horizontal Resolution/4). ^ maintained. The latter is useful, for example, when trying 

to re-establish lock during video conferencing without los- 

Once the estimated H row/ has been calculated, the VFA 18 ing the video conferencing channel altogether in the process, 

measures the horizontal resolution of the computer video 25 or if the display resolution is changed on the fly, such as 

signal 12 by again measuring the interval between events of during the display of a DOS screen, 

interest (as set forth in d, above) (step S30). Again, such Smart Video Switch and Multiplexer Control Mask 

measurement is made in GCLK units. If the measured Once the motion video is processed appropriately, the 

resolution is less than the expected resolution, H totaJ is aforementioned horizontal and vertical parameters of the 

incremented by one at step S32 and step S30 is repeated. 30 display of the computer 10 determined, and the motion video 

This has the effect of increasing the frequency of the and computer video signal 12 synchronized, the video 

synthesized pixel clock. If the measured resolution is less multiplexing system 13 must determine whether the com- 

that the expected resolution, is decremented by one at puter video signal 12 or the motion signal is to be displayed 

step S34 and step S30 is repeated. This has the effect of on the monitor 20. 

decreasing the frequency of the synthesized pixel clock. This 35 Referring again to FIG. 6, the smart video switch 14 is an 

process is repeated until the measured horizontal resolution analog switch used to source either the computer video 

is equal to the expected horizontal resolution. This ensures signal 12 or the motion video output from the video digital- 

that the synthesized pixel clock has been correctly synthe- to -analog (D/A) converter 41 to the screen of computer 

sized. monitor 20 through video amplifier 43. In operation, the 

In the embodiment shown in FIG. 10, the computer video 40 smart video switch 14 combines, or multiplexes, the corn- 
signal 12 is then further analyzed to determine if the display puter video signal with the motion video output from the 
of monitor 20 is interlaced or non-interlaced (step S50). This video digital-to-analog (D/A) converter 41, and then, upon 
is done in the VFA 18 by consecutive measurements of the information generated by a multiplexer control mask 
time difference between the leading edge of V^ and the (MCM) 34 (discussed in the following paragraphs), selects 
leading edge of H^,,, In non-interlaced video, this time 45 the correct image source (computer 10 or motion video 
difference will be constant. In interlaced video this differ- source), for display on the screen of monitor 20. Preferably 
ence varies by half a scan line for each successive V^. If the smart video switch 14 is a QS4A205 high speed analog 
interlaced video is detected, the condition is flagged and multiplexer manufactured by and available from Quality 
operation may be aborted (step S55), if desired, or the Semiconductor, Inc., 851 Martin Avenue, Santa Clara, 
process may continue and the remaining video timing 50 Calif., 95050. However, other similar commercially avail- 
parameters may be next measured and adjusted (step S60). able multiplexers may be used instead. In the present 

Once determination is made as to whether the display is invention, the smart video switch 14 is capable of switching 

interlaced or not, the remaining video timing parameters are between images on a boundary of at least every four (4) 

measured and adjusted accordingly in a manner similar to pixels, but may be made to switch for every one (1) pixel 

that discussed above (step S60). More specifically, the VFA 55 generated. While this would increase the resolution of the 

18 measures the remaining horizontal and vertical param- border between the computer video signal 12 from the host 

eters and programs the FC 11 in accordance with these computer 10 and the video image to be displayed, it would 

measurements. If desired, the video conference control also require more memory, and thus such increase in switch 

application (FIG. 1) can be caused to extinguish the blue 14 switching speed depends on the amount of memory 

border, as is done in the preferred embodiment. 60 available to the multiplexer control mask (MCM) 34, opera - 

At this point, the motion video is now synchronized with tion of which will now be discussed, 

the computer video signal 12 in all ways except for an As each raster line of the combined video is formed 

expected phase shift in vertical sync. Thus, the next step (motion video and computer video signal), the system of the 

(step S70) is to adjust the vertical phase of the motion video present invention determines which image source is to be 

signal in order to match the vertical phase of the computer 65 displayed — the computer video signal 12 or the motion 

video signal 12. The VFA 18 accomplishes this by counting video signal output from video D/A converter 41. This 

in counter 50 the pulses between the leading edge of decision is controlled by memory in the multiplexer control 
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mask (MCM) 34. Under the control of controller 32, the 
MCM 34 controls the sourcing to the smart video switch 14, 
of either the computer video signal 12 from the computer 10 
or motion video signal output from the video D/A converter 
41. Operation of the MCM 34 is similar in concept to alpha 5 
masks used in computer graphics and computer animation, 
and is commercially available (MARK: If we delete this 
sentence, we need to state that the MCM is commercially 
available and give the product and manufactured name or 
otherwise give a fuller description). The "mask" serves as a 10 
template for drawing a background "window" 6 (FIG. 2) 
into which the motion video signal from the local video 
source 33 and far-side video source (not shown) will ulti- 
mately be displayed (FIG. 1). Thus, the MCM 34 is used to 
determine the display size and location of the window which 15 
will display the video signal received from the video signal 
source 30. 

More particularly, each bit in the MCM 34 controls the 
source of video for a pixel or a multiple pixel block (e.g., a 
single bit in the MCM 34 controls a 4x4 pixel array in the 20 
preferred embodiment). The MCM 34 generates a continu- 
ous bitstream of pixel data having values of "(Tor "1". Such 
values represent whether the switch 14 will source the 
computer video signal 12 from the computer 10, or whether 
it will source the motion video signal output from video D/A 25 
converter 41. In the preferred embodiment, a bit value of "0" 
will cause the smart video switch 14 to source the computer 
video signal 12 for four (4) horizontally adjacent pixels of 
the screen, for four consecutive horizontal scan lines, while 
a bit value of "1" will cause the smart video switch 14 to 30 
source the motion video signal output from the video D/A 
converter 41 for the four (4) pixels for four scan lines. 
(Again, resolution can be increased up to one (1) pixel, if 
desired, subject only to the amount of memory available to 
the multiplexer control mask MCM 34). As seen in FIGS. 35 
1-3, the "windows" 6 created by the multiplexer control 
mask are much like other computer "windows" known in the 
art. Again, local video from the local video source 33 is 
ultimately displayed in one "window"; e.g., in the area 4, 
while video from the far-side video source is ultimately 40 
displayed in another window; e.g., in the area 5. Information 
generated by the computer video signal 12 is displayed in 
areas 2 and 3. Additional "windows" may be displayed by 
the MCM 34. Preferably, as discussed previously, these 
windows are used to display graphics information from an 45 
application such as a user interface program and which is 
used for controlling the system of the present invention. 
Although FIGS. 1-3 show these "windows" 6 to be 
rectangular, it will be appreciated that the MCM 34 may be 
programmed to display such "windows" in various other 50 
shapes. For example, if the granularity of the MCM 34 is 
made to be very fine — i.e., a resolution of one to two pixels, 
it is possible to create a window which has an arbitrary 
shape. Thus an outline view of the speaker could in fact be 
the "window". 55 

The content of the memory of MCM 34 may be controlled 
by the video conference control application or similar user 
interface program running in the computer 10, via a remote 
control system (RCS). In the video conferencing 
embodiment, this application would control the size, posi- 60 
tion and stacking order of the near- and far-side windows. 
The user controls these factors in the same manner he would 
for any computer window. For example, if the user resizes 
or moves a window containing the near- or far-side motion 
video, this information is transmitted back to the RCS and 65 
then back to the multiplexer system of the present invention 
through controller 32 and bus arbitration and control logic 
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45, the system controller 32 adjusting the contents of the 
MCM 34 memory accordingly. 

It is therefore apparent that in accordance with the present 
invention, an embodiment that fully satisfies the objectives, 
aims, and advantages is set forth above. While the invention 
has been described in conjunction with specific 
embodiments, it is evident that many alternatives, 
modifications, permutations, and variations will become 
apparent to those skilled in the art in light of the foregoing 
description. For example, although the video multiplexing 
system of the present invention has been discussed in 
reference to a video conferencing environment, it will be 
appreciated that such multiplexing system has a broader 
range of uses, and may be used in several applications; e.g., 
a communications broadcast environment or a multimedia 
environment. Additionally, such multiplexing system may 
be used in a video test instrument or in a video format 
converter. Furthermore, although the source of the computer 
video signal 12 in the preferred embodiment is a computer 
outputting VGA-style RGB video with separate H syfK and 
Vsync pulses, the present invention is not so limited, and may 
be extended to all versions of RGB video, including video 
with composite and V^, video with sync on green, 
as well as RS170 compliant video and its derivatives.. Id 
addition, the data and control path 15 which is established 
preferably by connecting the computer's parallel port to the 
video multiplexing system 13 may be that such as is con- 
sistent with the known IEEE 1394 standard. Additionally, 
although control of the motion video frame controller 11 is 
effected using software commands, it may alternatively be 
effected using a hardware implementation. Furthermore, 
although discussion of the present invention has been lim- 
ited to the use of same in the video conferencing 
environment, it will be appreciated that the multiplexing 
system of the present invention is not so limited and may be 
used in other environments, including, but not limited to, 
broadcast, multimedia and any other computer and video 
applications. Other embodiments will occur to those skilled 
in the art. Accordingly, it is intended that the present 
invention embrace all such alternatives, modifications, and 
variations as fall within the scope of the appended claims. 
What is claimed is: 

1. A system for overlaying a motion video signal onto an 
analog signal on a display, the system comprising: 

a motion video processor for receiving and processing 
said motion video signal into a signal having an analog 
video format; 

a video format analyzer and synchronizer device for 
receiving said analog signal and for determining video 
timing parameters and a corresponding original pixel 
clock of said analog signal and for controlling video 
timing parameters of said motion video signal to match 
said video timing parameters of said analog signal 
determined by said video format analyzer and synchro- 
nizer device so as to provide an output motion video 
signal which is synchronized with said analog signal; 
and, 

a display determining device for determining the display 
of said analog output signal or said synchronized output 
motion video signal on said display. 

2. The system of claim 1, wherein said video format 
analyzer and synchronizer device includes: 

a video format analyzer for determining horizontal and 
vertical video timing parameters of said analog signal, 
including vertical and horizontal sync times, active 
video time and vertical phase of said analog signal; 
a clock signal generator for receiving components of said 
analog signal and providing a synthesized clock signal 
to track said original pixel clock of said analog signal; 
and, 
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a frame controller for receiving a group clock signal, said 16. The system of claim 15, wherein said data and control 

group dock signal being a derivative of said synthe- path includes a data port available on said computer 

sized clock signal, and for providing internal synchro- 17. The system of claim 16, wherein said data port is 

nization signals for synchronizing said video param- selected from the group comprising a parallel printer port, a 

eters of said motion video signal and said video 5 USB port, and a serial port. 

parameters of said analog signal. 18. The system of claim 15, wherein said data and control 

3. The system of claim 2, wherein said clock signal path comprises an IEEE 1394 communication line, 
generator further maintains synchronization of said frame 19. The system of claim 15, wherein said computer 
controller and said analog signal. includes a user interface for providing control information 

4. The system of claim 2, wherein the frequency of said 1Q and data to said system over said data and control path, and 
group clock signal is one-fourth the frequency of the syn- for generating windows on said display, wherein said analog 
thesized clock signal. output signal or said synchronized output motion video 

5. The system of claim 3, wherein said group clock signal signal ^ displayed in said windows. 

is provided to said video format analyzer for determining 20 ^ s of daim 19j wherein mfonnatiorj repre . 

said horizontal timing parameters of said analog signal. senti ^ ^ sfa and i[ion of ^ fe 

6 The system of claim 5, wherein said internal synchro- transmitted b ^ ^ imerface tQ said 

nization signals include horizontal and vertical synchroni- — . J . f , ■ L • ■ , « 

zation signals, wherein said horizontal synchronization sig- 21 ' cla ™ 19 > wherein the size, shape and 

nal is provided to said clock signal generator to synthesize ^ oslilon of said windows are controllable by a user of said 

said original clock signal from said analog signal, and svstem ' and w &erein w hen said user changes said size, 

wherein said vertical synchronization signal is provided to 20 shape, and position of said windows, information represent- 

said video format analyzer in order to maintaine said vertical m S ^d change is transmitted by said user interface to said 

phase of said motion video signal and said analog signal. system. 

7. The system of claim 2, further comprising: 22. The system of claim 7, wherein said analog signal 
a memory for storing vertical resolutions and expected includes vertical and horizontal sync pulses each having 

horizontal resolutions correlated with a measured ver- 2 5 leadin S edges, and wherein said video format analyzer 

tical resolutions, wherein said video format analyzer further determines whether said display is an interlaced 

measures the vertical resolution of said analog signal display by consecutively measuring the time difference 

and refers to said memory to determine for said mea- between the leading edge of said horizontal sync pulses and 

sured vertical resolution an expected horizontal reso- the leading edge of said vertical sync pulses, 

lution. 30 23. The system of claim 22, wherein said video format 

8. The system of claim 7, wherein said video format analyzer determines said display to be an interlaced display 
analyzer uses said expected horizontal resolution to calcu- wnen said time difference between the leading edge of said 
late a "horizontal total" value, wherein said "horizontal horizontal sync pulses and the leading edge of said vertical 
total" value is used to recreate said original pixel clock of sync pulses vary by half of a horizontal ^ ^ for eacb 

said analog signal consecutive vertical sync pulse. 

9. ihe system ot claim 8, wherein said horizontal total 24> The tem of daim 22 wherein 

said video format 

value comprises the number of periods of said group clock , , ; ., \ A . . . , . 

1 u- u * u • ; i i- c -j j- i analyzer determines said display to be a non-interlaced 

signal which occur in a horizontal scan line ot said display. ,. , . ... ,.«. , 

10. The system of claim 7, wherein said storing of vertical d f P la J ^ hen tune difference between the leading edge 
resolutions and expected horizontal resolutions based on of said horizontal sync pulses and the leading edge of said 
said vertical resolution is based on VESA standards. 40 vertical sync pulses is constant for each consecutive vertical 

11 . The system of claim 9, further comprising a controller, svnc P^se* 

wherein said video format analyzer compares said measured 25t The system of claim 2, wherein said video format 

horizontal resolution with said expected resolution, and analyzer comprises a programmed array logic, 

wherein if said measured horizontal resolution does not 26 ^ system of claim 2, wherein said analog signal is 

match said expected horizontal resolution, said controller 45 received from an analog signal source, and wherein said 

adjusts said "horizontal total" so that said frequency of said display is capable of displaying a plurality of frames, each 

synthesized clock signal is adjusted to track said original frame comprising a plurality of scan lines, and wherein said 

pixel clock of said analog signal. anaio S si S nal deludes a video source for providing a 

12. The system of claim 11, wherein if said measured video having known video content on the first and last 
horizontal resolution of said analog signal is lower than said 50 scan Une of each of ^ plurality of display frames, 
expected horizontal resolution, said "horizontal total" is 27 ' ^ system of claim 26, wherein said video format 
increased and said frequency of said synthesized clock analyzer further includes: 

signal is increased. a known video content detecting device for detecting said 

13. The system of claim 11, wherein if said measured video signal having known video content, wherein said 
horizontal resolution of said analog signal is higher than said 55 video format analyzer will commence measurement of 
expected horizontal resolution, said "horizontal total** is ihe active video time of said analog signal after said 
decreased and said frequency of said synthesized clock known video content detecting device detects said 
signal is decreased. video signal having known video content. 

14. The system of claim 11, wherein said clock signal 28. The system of claim 26, wherein said known video 
generator produces said synthesized clock signal by multi- 60 source comprises: 

plying the horizontal sync frequency of said analog signal by a pixel generating driver for generating a pixel border on 

said "horizontal total" received from said controller so that the perimeter of said display. 

said frequency of said synthesized clock signal tracks said 29. The system of claim 27, wherein said known video 

original pixel clock frequency of said analog signal. detecting device comprises: 

15. The system of claim 2, wherein said system is 65 a comparator for receiving said video signal having 
communicatively coupled to a computer via data and control known video content and for comparing said video 
path. signal with a predetermined threshold value, wherein 
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said video formal analyzer commences measurement of 
the active video time if a value of said video signal 
having known video content exceeds said threshold 
value. 

30. The system of claim 29, wherein said comparator 5 
comprises an operational amplifier. 

31. The system of claim 29, wherein said threshold value 
is 0.25 volts. 

32. The system of claim 28, wherein said pixel border 
generated by said pixel generating driver comprises blue to 
pixels. 

33. The system of claim 28, wherein said pixel border 
generated by said pixel generating driver comprises red 
pixels. 

34. The system of claim 28, wherein said pixel border is 
generated by said pixel generating driver comprises green 
pixels. 

35. The system of claim 32, wherein said each side of said 
pixel border generated by said pixel generating driver on 
said display is eight pixels in depth. 20 

36. The system of claim 2, wherein said clock signal 
generator comprises a phase-locked loop. 

37. The system of claim 36, wherein said phase-locked 
loop is a wide-band phase-locked loop. 

38. The system of claim 36, wherein said video format 25 
analyzer further comprises: 

a normalizer for receiving said horizontal pulses and 
vertical pulses of said analog signal, wherein said 
polarity of said horizontal pulses and vertical pulses of 
said analog signal is unknown, and for providing said 30 
horizontal pulses and vertical pulses of said analog 
signal with uniform polarity to said phase -locked loop. 

39. The system of claim 38, wherein said normalizer 
comprises: 

a counter for counting for a specified period, said hori- 35 
zontal pulses and vertical pulses of said analog signal, 
wherein said counter counts up when said polarity of 
said horizontal pulses and vertical pulses is positive and 
counts down when said polarity of said horizontal 
pulses and vertical pulses is negative, and wherein said 40 
counter outputs a sign bit at the end of said period; and 

logic for receiving said sign bit from said counter and for 
outputting a signal of known polarity. 

40. The system of claim 39, wherein said polarity is 45 
positive. 

41. The system of claim 2, wherein said motion video 
signal and said analog signal each include horizontal and 
vertical sync pulses, video format analyzer further compris- 

b 8 : 50 
interrupt logic for generating an interrupt if said vertical 
sync pulse of said motion video signal is not synchro- 
nized with said vertical sync pulse of said analog 
signal, wherein if said interrupt logic generates an 
interrupt, said video format analyzer will prevent said 55 
display determining device from displaying said 
motion video signal on said display until said vertical 
sync pulse of said motion video signal becomes syn- 
chronized with said vertical sync pulse of said analog 
signal. 60 

42. The system of claim 2, wherein said motion video 
signal and said analog signal each include horizontal and 
vertical sync pulses, video format analyzer further compris- 
ing: 

interrupt logic for generating an interrupt if said vertical 65 
sync pulse of said motion video signal is not synchro- 
nized with said vertical sync pulse of said analog 



signal, wherein if said interrupt logic generates and 
interrupt, said display determining device will continue 
to display said motion video signal on said display. 

43. The system of claim 2, wherein said motion video 
processor comprises: 

a converter to convert said motion video signal having a 

first format to a digital signal; and, 
a digital to analog converter for receiving said digital 

signal and for providing a second analog signal. 

44. The system of claim 43, wherein said converter 
comprises: 

a video converter for receiving said motion video signal 
having said first format and converting said signal to a 
4:2:2 YUV formaned data stream; 

a video coprocessor; and 

video memory for receiving said 4:2:2 YUV formatted 
data stream under the control of said video coprocessor, 
wherein said video coprocessor reads out said 4:2:2 
YUV formatted data stream from said video memory 
and converts and scales said 4:2:2 YUV formatted data 
stream into said digital analog signal, and wherein said 
video coprocessor writes said digital analog signal into 
said video memory, 

45. The system of claim 44, wherein said video memory 
comprises video random access memory (VRAM). 

46. The system of claim 43, wherein said digital to analog 
converter includes divider logic, said digital to analog con- 
verter receiving said synthesized clock signal from said 
clock signal means and said divider logic dividing said 
synthesized clock signal to produce said group clock signal, 
wherein said group clock signal has a lower frequency than 
said synthesized clock signal. 

47. The system of claim 46, wherein a period of said 
group clock signal is four pixels. 

48. The system of claim 1, wherein said display deter- 
mining device comprises: 

a video switch for combining said analog signal and said 
synchronized motion video signal, and for sourcing 
said analog signal or said synchronized motion video 
signal to said display; and, 

a source controller having an output for controlling said 
sourcing of said- video switch according to said output, 

49. The system of claim 48, wherein said combined 
analog signal and synchronized motion video signal form 
raster lines for display on said display, said source controller 
controlling said sourcing of said combined analog signal and 
synchronized motion video signal for each raster line. 

50. The system of claim 48, wherein said display is 
capable of displaying a plurality of frames, each frame 
including a plurality of scan lines, and wherein said output 
of said source controller controls said video switch to source 
a preselected number of pixels of said analog signal or said 
synchronized motion video signal per scan line. 

51. The system of claim 50, wherein said preselected 
number of pixels per scan line of said analog signal and 
synchronized motion video signal is four. 

52. The system of claim 50, wherein said source control- 
ling means comprises a multiplexer control mask. 

53. The system of claim 48, wherein said video switch is 
a high speed switch. 

54. The system of claim 52, wherein said multiplexer 
control mask includes a memory having a plurality of 
memory locations for storing a plurality of values, and 
wherein the sourcing of said preselected number of pixels of 
said analog signal or said synchronized motion video signal 
is determined by the plurality of values stored in said 
memory locations. 
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55. The system of claim 54, wherein said video switch parameters of said motion video signal and said video 
will source said preselected number of pixels of said analog parameters of said analog RGB signal. 

signal to said display when any of said plurality of values; 68. The system of claim 67, wherein said clock signal 
in said memory of said multiplexer control mask is 0, and means further maintains synchronization of said frame con- 
will source said preselected number of pixels of said syn- 5 trailer means and said analog RGB signal, 
chronized motion video signal to said display when any of 69. The system of claim 67, wherein the frequency of said 
said plurality of values in said memory of said multiplexer group clock signal is one-fourth the frequency of the syn- 
control mask is 1. thesized clock signal. 

56. The system of claim 55, wherein preselected number 70. The system of claim 68, wherein said group clock 
of pixels is four, 10 signal is provided to said video format analyzer for deter- 

57. The system of claim 48, wherein said video switch mining said horizontal timing parameters of said analog 
switches after every four pixels of said analog signal and RGB signal. 

said synchronized motion video signal. 71. The system of claim 70, wherein said internal syn- 

58. The system of claim 48, wherein said video switch chronization signals include horizontal and vertical synchro- 
switches after every one pixel of said analog signal and said 15 nization signals, wherein said horizontal synchronization 
synchronized motion video signal. signal is provided to said clock signal means to synthesize 

59. The system of claim 52, wberein said multiplexer said original clock signal from said analog RGB signal, and 
control mask causes at least one window to be displayed on wherein said vertical synchronization signal is provided to 
said display. said video format analyzer in order to maintaine said vertical 

60. The system of claim 59, wherein said at least one 20 phase of said motion video signal and said analog RGB 
window is rectangular. signal. 

61. The system of claim 59, wherein said at least one 72. The system of claim 67, further comprising: 
window has an arbitrary shape. a memory for storing vertical resolutions and expected 

62. The system of claim 61, wherein said system is horizontal resolutions correlated with a measured ver- 
communicatively coupled to a computer, said display is a 25 tical resolution, wherein said video format analyzer 
computer display, and said analog signal is an RGB video measures the vertical resolution of said analog RGB 
signal output from said computer. signal and refers to said memory to determine for said 

63. The system of claim 2, wherein said system is used in measured vertical resolution an expected horizontal 
a communications broadcast environment. resolution. 

64. The system of claim 2, wherein said system is used in 30 73. The system of claim 72, wherein said video format 
a multimedia environment. analyzer uses said expected horizontal resolution to calcu- 

65. The system of claim 2, wherein said system is used in late a "horizontal total" value, wherein said "horizontal 
a video conferencing environment. total" value is used to recreate said original pixel clock of 

66. A video conferencing system for overlaying a motion said analog signal. 

video signal onto an RGB analog signal on a computer 35 74. The system of claim 73, wherein said "horizontal 

display, the system comprising: total" value comprises the number of periods of said group 

motion video processing means for receiving and pro- c * oc k signal which occur in a horizontal scan line of said 

cessing said motion video signal into an analog RGB display. 

signal; 75. The system of claim 72, wherein said storing of 

a video 'format analyzer and synchronizer device for 40 ^f 1 predicted horizontal resolutions 

receiving said analog RGB signal and for determining J"* on sald vertlcal ««*Ki<» * °n VESA stan- 

the video timing parameters of said analog RGB signal a ~' 

and for controlling the video timing parameters of said 76 ' J** of claim further comprising a 

motion video signal to match said video timing param- controller, wherein said video format analyzer compares 

eters of said analog RGB signal determined by said 45 said 1 measured horizontal resolution with said expected 

video format analyzer and synchronizer device so as to "^tion, w herem if said measured horizontal resolu- 

provide an output motion video signal which is syn- Uon does 001 malch 531(1 exp*** horizontal resolution, said 

chronized with said analog RGB signal; aod, controller adjusts said "horizontal totar so that said fre- 

, , . . . r - . • , ■ , quency of said synthesized clock signal is adjusted to track 

display determining means for determining the display of r , . , 

■a id on . . • i a if * j ; * 50 said ongmal pixel clock of said analog RGB signal, 

said RGB output signal or said synchronized output * , * , • i_ • •* -J j 

■j . i .j j- i 77. The system of claim 76, wherein if said measured 

motion video signal on said display. . . . . J . 4 . c ., ' . . . . 

c - ™ t J r . . ££ . r . 7 . . - t horizontal resolution of said analog RGB signal is lower 

67. The system of claim 66, wherein said video format . . , , , . , . f * w . . , . 
, / u • j • ■ i j ^an said expected horizontal resolution, said horizontal 

analyzer and synchronizer device includes: . 4 ,„ - • . . c I j ,u • j 

J . e J total is increased and said frequency of said synthesized 

a video format analyzer for determining horizontal and 55 clock signal fa mcreased . 

vertical video timing parameters of said analog RGB 78 The system of claim 76( wherein tf said measured 

signal, including vertical and horizontal sync times, horizontal resolution of said analog RGB signal is higher 

active video time and vertical phase of said analog mao said expecled horizontal resolution, said "horizontal 

RGB signal; tota l» ^ decreased and said frequency of said synthesized 

clock signal means for receiving components of said go clock signal is decreased. 

analog RGB signal and providing a synthesized clock 79. The system of claim 76, wherein said clock signal 

signal to track said original pixel clock of said analog means produces said synthesized clock signal by multiply- 

RGB signal; and, m g the horizontal sync frequency of said analog RGB signal 

frame controller means for receiving a group clock signal, by said "horizontal total" received from said controller so 

said group clock signal being a derivative of said 65 that said frequency of said synthesized clock signal tracks 

synthesized clock signal, and for providing internal said original pixel clock frequency of said analog RGB 

synchronization signals for synchronizing said video signal. 
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80. The system of claim 72, wherein said analog RGB 
signal includes vertical and horizontal sync pulses each 
having, leading edges, and wherein said video format ana- 
lyzer further determines whether said display is an interlaced 
display by consecutively measuring the time difference 5 
between the leading edge of said horizontal sync pulses and 
the leading edge of said vertical sync pulses. 

81. The system of claim 80, wherein said video format 
analyzer determines said display to be an interlaced display 
when said time difference between the leading edge of said 
horizontal sync pulses and the leading edge of said vertical 
sync pulses vary by half of a horizontal scan line for each 
consecutive vertical sync pulse. 

82. The system of claim 80, wherein said video format 
analyzer determines said display to be a non-interlaced 
display when said time difference between the leading edge 15 
of said horizontal sync pulses and the leading edge of said 
vertical sync pulses is constant for each consecutive vertical 
sync pulse. 

83. The system of claim 67, wherein said video format 
analyzer comprises a programmed array logic. 20 

84. The system of claim 67, wherein said analog RGB 
signal is received from an analog RGB signal source, and 
wherein said display is capable of displaying a plurality of 
frames, each frame comprising a plurality of scan lines, and 
wherein said analog RGB signal source includes known 2 $ 
video means for providing a video signal having known 
video content on the first and last scan line of each of said 
plurality of display frames. 

85. The system of claim 84, wherein said video format 
analyzer further includes: 30 

known video detecting means for detecting said video 
signal having known video content, wherein said video 
format analyzer will commence measurement of the 
active video time of said analog RGB signal after said 
known video detecting means detects said video signal 35 
having known video content, 

86. The system of claim 84, wherein said known video 
means comprises: 

pixel generating means for generating a pixel border on 
the perimeter of said display. 40 

87. The system of claim 85, wherein said known video 
detecting means comprises: 

comparator means for receiving said video signal having 
known video content and for comparing said video 
signal with a predetermined threshold value, wherein 45 
said video format analyzer commences measurement of 
the active video time if a value of said video signal 
having known video content exceeds said threshold 
value. 

88. The system of claim 86, wherein said pixel border 50 
generated by said pixel generating means comprises blue 
pixels. 

89. The system of claim 86, wherein said pixel border 
generated by said pixel generating means comprises red 
pixels. 55 

90. The system of claim 86, wherein said pixel border 
generated by said pixel generating means comprises green 
pixels. 

91. The system of claim 87, wherein said comparator 
means comprises an operational amplifier. 60 

92. The system of claim 87, wherein said threshold value 
is 0.25 volts. 

93. The system of claim 86, wherein said each side of said 
pixel border generated by said pixel generating means on 
said display is eight pixels in depth. 65 

94. The system of claim 67, wherein said clock signal 
means comprises a phase-locked loop. 
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95. The system of claim 94, wherein said phase-locked 
loop is a wide-band phase-locked loop. 

96. The system of claim 94, wherein said video format 
analyzer further comprises: 

a normalize r for receiving said horizontal pulses and 
vertical pulses of said analog RGB signal, wherein said 
polarity of said horizontal pulses and vertical pulses of 
said analog RGB signal is unknown, and for providing 
said horizontal pulses and vertical pulses of said analog 
RGB signal with uniform polarity to said phase-locked 
loop. 

97. The system of claim 96, wherein said normalizer 
comprises: 

a counter for counting for a specified period, said hori- 
zontal pulses and vertical pulses of said analog RGB 
signal, wherein said counter counts up when said 
polarity of said horizontal pulses and vertical pulses is 
positive and counts down when said polarity of said 
horizontal pulses and vertical pulses is negative, and 
wherein said counter outputs a sign bit at the end of said 
period; 

logic means for receiving said sign bit from said counter 
and for outputting a signal of a known polarity. 

98. The system of claim 97, wherein said polarity is 
positive. 

99. The system of claim 67, wherein said motion video 
signal and said analog RGB signal each include horizontal 
and vertical sync pulses, video format analyzer further 
comprising: 

interrupt logic means for generating an interrupt if said 
vertical sync pulse of said motion video signal is not 
synchronized with said vertical sync pulse of said 
analog RGB signal, wherein if said interrupt logic 
means generates an interrupt, said video format ana- 
lyzer will prevent said display determining means from 
displaying said motion video signal on said display 
until said vertical sync pulse of said motion video 
signal becomes synchronized with said vertical sync 
pulse of said analog RGB signal. 

100. The system of claim 67, wherein said motion video 
signal and said analog RGB signal each include horizontal 
and vertical sync pulses, video format analyzer further 
comprising: 

interrupt logic means for generating an interrupt if said 
vertical sync pulse of said motion video signal is not 
synchronized with said vertical sync pulse of said 
analog RGB signal, wherein if said interrupt logic 
means generates and interrupt, said display determining 
means will continue to display said motion video signal 
on said display. 

101. The system of claim 67, wherein said motion video 
processing means comprises: 

converting means to convert said motion video signal 
having a first format to a digital RGB signal; and, 

a digital to analog converter for receiving said digital 
RGB signal and for providing a second analog RGB 
signal. 

102. The system of claim 101, wherein said converting 
means comprises: 

a video converter for receiving said motion video signal 
having said first format and converting said signal to a 
4:2:2 YUV formatted data stream; 

a video coprocessor; and, 

video memory for receiving said 4:2:2 YUV formatted 
data stream under the control of said video coprocessor, 
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wherein said video coprocessor reads out said 4:2:2 of said plurality of values in said memory of said multiplexer 

YUV formatted data stream from said video memory control mask is 0. 

and converts and scales said 4:2:2 YUV formatted data 115. The system of claim 112, wherein preselected num- 

stream into said digital RGB signal, and wherein said ber of pixels is four. 

video coprocessor writes said digital RGB signal into 5 116. The system of claim 106, wherein said video switch 

said video memory. switches between synchronized motion video signal and said 

103. The system of claim 102, wherein said video analog RGB signal after every four pixels of said analog 
memory comprises video random access memory (VRAM). RGB signal and said synchronized motion video signal. 

104. The system of claim 101, wherein said digital to 117. The system of claim 106, wherein said video switch 
analog converter divider logic, said digital to analog con- 1Q switches after every one pixel of said analog RGB signal and 
verter receiving said synthesized clock signal from said said synchronized motion video signal. 

clock signal means and said divider logic dividing said 118. The system of claim 110, wherein said multiplexer 

synthesized clock signal to produce said group clock signal, control mask causes a window to be displayed on said 

wherein said group clock has a lower frequency than said display. 

synthesized clock signal. 15 119. The system of claim 118, wherein said window is 

105. The system of claim 104, wherein a period of said rectangular. 

group clock signal is four pixels. 120. The system of claim 118, wherein said window has 

106. The system of claim 67, wherein said display deter- an arbitrary shape. 

mining means comprises: 121. The system of claim 67, wherein said system is 

a video switch for combining said analog RGB signal and 20 communicatively coupled to a computer via data and control 

said synchronized motion video signal, and for sourc- means. 

ing said analog RGB signal or said synchronized 122. The system of claim 121, wherein said data and 
motion video signal to said display; and, control means includes a data port available on said corn- 
source controlling means having an output for controlling puter. 
said sourcing of said video switch according to said 25 123. system of claim 122, wherein said data port is 
output. selected from the group comprising a parallel printer port, a 

107. The system of claim 106, wherein said combined USB P ort » and a senal P ort - 

analog RGB signal and synchronized motion video signal 124. The system of claim 121, wherein said data and 

form raster lines for display on said display, and said source control means comprises an IEEE 1394 communication line, 

controlling means determining to control said sourcing of 30 125. The system of claim 121, wherein said computer 

said combined analog RGB signal and synchronized motion includes user interface program means for providing control 

video signal for each raster line. information and data to said system over said data and 

108. The system of claim 103, wherein said display is control means, and for generating windows on said display, 
capable of displaying a plurality of frames, each frame wherein said analog output signal or said synchronized 
including a plurality of scan lines, and wherein said output 35 output motion video signal is displayed in said windows, 
of said source controlling means controls said video switch 126. The system of claim 125, wherein information rep- 
to source a preselected number of pixels of said analog RGB resenting the size, shape, and position of said windows is 
signal or said synchronized motion video signal per scan transmitted by said user interface program means to said 
line. system. 

109. The system of claim 108, wherein said preselected 40 127. The system of claim 125, wherein the size, shape, 
number of pixels per scan line of said analog RGB signal and position of said windows are controllable by a user of 
and synchronized motion video signal is four. said system, and wherein when said user changes said size, 

U0. The system of claim 108, wherein said source shape, and position of said windows, information represent- 

controlling means comprises a multiplexer control mask. m S said change is transmitted by said user interface program 

HI, The system of claim 106, wherein said video switch 45 means to said system, 

is a high speed switch. 128. The system of claim 67, wherein said system is used 

112. The system of claim 110, wherein said multiplexer in * communications broadcast environment. 

control mask includes a memory having a plurality of 129. The system of claim 67, wherein said system is used 

memory locations for storing a plurality of values, and m a multimedia environment. 

wherein the sourcing of said preselected number of pixels of 50 130. A video conferencing system communicatively 
said analog RGB signal or said synchronized motion video coupled to a computer having a display, comprising: 
signal is determined by the plurality of values stored in said motion video processing means for receiving and pro- 
memory locations. cessing a motion video signal having video timing 

113. The system of claim 112, wherein said video switch parameters into a signal having an RGB format; 

will source said preselected number of pixels of said analog 55 a video format analyzer and synchronizer device for 

RGB signal to said display when any of said plurality of receiving from said computer an analog RGB signal 

values in said memory of said multiplexer control mask is 0, having horizontal and vertical video timing parameters 

and will source said preselected number of pixels of said and an original pixel clock, and for determining said 

synchronized, motion video signal to said display when any horizontal and vertical video timing parameters of said 

of said plurality of values in said memory of said multiplexer 60 analog RGB signal, and for controlling said video 

control mask is 1. timing parameters of said motion video signal to match 

114. The system of claim 112, wherein said video switch said video timing parameters of said analog RGB signal 
will source said preselected number of pixels of said analog determined by said video format analyzer and synchro- 
RGB signal to said display when any of said plurality of nizer device so as to provide an output motion video 
values in said memory of said multiplexer control mask is 1 , 65 signal which is synchronized with said analog RGB 
and will source said preselected number of pixels of said signal, said video format analyzer and synchronizer 
synchronized motion video signal to said display when any device including 
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a video format analyzer for determining said horizontal tion; and uses said expected horizontal resolution to calcu- 

and vertical video liming parameters of said analog late a Horizontal total" value, wherein said Horizontal total" 

RGB signal, including vertical and horizontal sync value is used to recreate said original pixel clock of said 

times, active video time and vertical phase of said analog RGB signal; and, a controller, wherein said video 

analog RGB signal; 5 format analyzer compares said measured horizontal resolu- 

a phase-locked loop for receiving components of said tion ™* ****** resol * ion > and * here * * «*| 

analog RGB signal and providing a synthesized clock measured horizontal resolution does not match said expected 

i . . -i *u ■ i • i i i f m i horizontal resolution, said controller adjusts said "horizontal 

signal to track fce ongmal pixel clock of said analog ^ M ^ ^ ofs]jd symhesized dock rigM , 

signal, and, . ^ ^j^^ m order t0 titc y. ^ original c i oc k 0 f ^ 

a frame controller for receiving a group clock signal, said 10 analog RGB signal, 

group clock signal being a derivative of said synthe- 134. The system of claim 133, wherein said Horizontal 

sized clock signal, and for providing internal synchro- total" value comprises the number of periods of said group 

nization signals for synchronizing said video param- clock signal which occur in a horizontal scan line of said 

eters of said motion video signal and said video display. 

parameters of said analog RGB signal; 15 135. The system of claim 133, wherein said analog RGB 

a video switch for combining said analog RGB signal and signal a received from an analog RGB signal source, and 

said synchronized motion video signal, and for sourc- wherein said display is capable of displaying a plurality of 

ing a preselected number of pixels of said analog RGB frames > each Erame comprising a plurality of scan lines, 

signal or a preselected number of pixels of said syn- whereit ! said M4 J°* RG . B . ^ , i " cludes 1 P™ 1 

chronized motion video signal to said display; and, a 20 Seating means for prov.dmg ,a v.deo signal having known 

multiplexer control mask including a memory having v ! deo J 0 "™. on first Md . last *** each of 531(1 
memory locations, wherein said multiplexer control PluraHlyof display frames, said system further comprising: 
mask Will cause said video switch to source said known video detectmg means for detecung said v.deo s.gnal 
preselected number of pixels of said analog RGB signal * avm S ^ ovm v ' de ° content ' 1 mdudm , g com P ara,or means 
to said display when any of said plurality of values in 25 for giving said video signal having known video content 
said memory locations of said multiplexer control mask < eceivia & and «nipf™g *" d video signal with a pre- 
memory has a first value, and will cause said video d ^™ined threshold value, wherein sari video 1 format ana- 
switch to source said preselected number of pixels of commences measurement of the active video time if a 
said synchronized motion video signal to said display value ° £ sa J d v,deo , havm S vldeo content 
when any of said plurality of values in said memory 30 exc^ said threshold value 

locations of said multiplexer control mask memory has 136 ™ e svstem ° f claim u 135 . *» d pixel gener- 

a second value ating S enerates a blue P ixe * border having a depth of eight 

131. The system of claim 130, wherein said motion video ^ 0 " me P erimete ! <f said . . A u u M 

processing means comprises: , 137 : ^J* 8 ?" of claun 135 ' wherem *™ hold 

- . . . , 35 value is 0.25 volts. 

a video converter for receiving said motion video signal „ . , ^, . 1M A 

. . , „ - _, & . . , 138. The system of claim 133, further comprising a 

having said first format and converting said signal to a r e • . - A . , , , *, , 

a * *\mx7 r normalizer for receiving said horizontal pulses and vertical 

4:2:2 YUV formatted data stream: , f *. , W>r» • i u • • j i •* * 

' pulses of said analog RGB signal, wherem said polarity of 

a video coprocessor; sa j d horizontal pulses and vertical pulses of said analog 
video random access memory for receiving said 4:2:2 40 RGB signal is unknown, and for providing said horizontal 
YUV formatted data stream under the control of said pulses and vertical pulses of said analog RGB signal with 
video coprocessor, wherein said video coprocessor uniform polarity to said phase-locked loop, 
reads out said 4:2:2 YUV formatted data stream from 139. The system of claim 135, further comprising a user 
said video random access memory and converts and interface program running on said computer, wherein corn- 
scales said 4:2:2 YUV formatted data stream into said 45 mands sent from said user interface program determine the 
digital RGB signal, and wherein said video coprocessor plurality of values stored in said multiplexer control mask 
writes said digital RGB signal into said video random memory and thus the sourcing of said preselected number of 
access memory; and, pixels of said analog ROB signal or said synchronized 
a digital to analog converter for receiving said digital motion video signal to said display. 
RGB signal and for providing a second analog RGB 50 140. A video format analyzing and synchronizing device 
signal. for receiving an analog signal having a plurality of video 

132. The system of claim 130, wherein said preselected timing parameters of unknown format from an analog 
number of pixels is four. source, including horizontal and vertical sync time and 

133. The system of claim 131, wherein said analog RGB active video time, and for receiving a motion video signal 
signal includes vertical and horizontal sync pulses, and 55 having a plurality of video timing parameters of unknown 
wherein said digital to analog converter includes divider format from a motion video source, including horizontal and 
logic, said digital to analog converter receiving said synthe- vertical sync time and active video time, wherein said video 
sized clock signal from said clock signal means and said format analyzing and synchronizing device analyzes said 
divider logic dividing said synthesized clock signal to pro- analog signal to determine said plurality of video timing 
duce said group clock signal, wherein said group clock 60 parameters of said analog signal and to provide an analyzed 
signal has a lower frequency than said synthesized clock signal containing said determined video timing parameters 
signal, and system further comprising: a memory for storing of said analog signal in order to control said plurality of 
vertical resolutions and expected horizontal resolutions cor- video timing parameters of said motion video source in 
related with a measured vertical resolutions, wherein said accordance with said video timing parameters of said analog 
video format analyzer measures the vertical resolution of 65 signal so that said video timing parameters of said motion 
said display and refers to said memory to determine for said video source are identical to and synchronized with said 
measured vertical resolution an expected horizontal resolu- video timing parameters of said analog signal. 
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141. The video format analyzing and synchronizing 
device of claim 140, further comprising: 

a video format analyzer for determining said video param- 
eters of said analog signal; and, 

clock signal means for providing a synthesized clock 5 
signal and responsive to said analog video parameters 
determined by said video format analyzer to provide a 
clock signal adjusted according to said analog signal 
video parameters, said adjusted clock signal for syn- 
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chronizing said video parameters of said motion video 
signal and said video parameters of said analog signal. 

142. The system of claim 141, wherein said analog signal 
is an analog RGB video signal output from a computer. 

143. The system of claim 141, wherein said clock signal 
means comprises a phase locked-loop. 

***** 
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